Skip to content

fix: benchmark page CB R23 label, test condition notes (DI-673)#264

Open
celanthe wants to merge 3 commits into
mainfrom
fix/benchmark-table-cb-r24
Open

fix: benchmark page CB R23 label, test condition notes (DI-673)#264
celanthe wants to merge 3 commits into
mainfrom
fix/benchmark-table-cb-r24

Conversation

@celanthe

@celanthe celanthe commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Corrects the column header in the standard models table from CB R23 to CB R24
  • Updates the test condition note to clarify that the two tables come from different test runs: standard models uses macOS 15.1 / Xcode 16.1 / CB R24, full results is the original macOS 13.4.1 / CB R23 run
  • Switches the benchmarking baseline from G5L (M1) to M2.M — M1 was never re-tested against the newer benchmark suite (confirmed by Matthew Pulsipher)
  • Drops Intel machines (G4B, G2, G4A) from the full results table (confirmed by Matthew Pulsipher)
  • Updates Overview benchmark list from Cinebench R23 to Cinebench R24

Tracks DI-673.

Still pending (blocking merge)

@matt-pulsipher to confirm the full results table values are acceptable as-is (old CB R23 data for remaining machines), or provide updated numbers.

Test plan

  • Verify standard models table column header reads CB R24
  • Verify baseline section shows M2.M at 1.00x
  • Verify Intel rows are gone from full results
  • @matt-pulsipher to sign off on full results table

🤖 Generated with Claude Code

…st conditions

The standard models table was updated with macOS 15.1 / Xcode 16.1 /
Cinebench R24 data but the column header still said CB R23. The full
results table remains the original macOS 13.4.1 / CB R23 run.

Pending: baseline section and full results table still need Matthew's
updated numbers (tracked in DI ticket).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@celanthe celanthe self-assigned this Jun 18, 2026
@celanthe celanthe requested a review from matt-pulsipher June 18, 2026 20:22
Per Matthew Pulsipher: M1 was never re-tested against the newer
benchmark suite, so M2.M is now the 1.00x baseline. Intel machines
dropped from the full results table as performance is no longer a
differentiating use case for that hardware.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@celanthe celanthe added the documentation Improvements or additions to documentation label Jun 18, 2026
@celanthe celanthe marked this pull request as ready for review June 18, 2026 20:55
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant